Pressure compensation in display sound device

ABSTRACT

A device to process an audio signal representing output sound includes one or more processors configured to generate, responsive to sensor data indicative of pressure detected at a housing of the device, output data based on a predicted effect of the pressure on an acoustic output of the device. The one or more processors are also configured, responsive to the output data, to adjust operation of an audio playback component that generates the acoustic output.

I. CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims priority from U.S. Provisional PatentApplication No. 62/869,729, filed Jul. 2, 2019, entitled “PRESSURECOMPENSATION IN DISPLAY SOUND DEVICE,” which is incorporated byreference in its entirety.

II. FIELD

The present disclosure is generally related to display sound devices andmore specifically, to audio compensation for pressure applied to adisplay sound device.

III. DESCRIPTION OF RELATED ART

Phone manufactures have recently introduced “display sound” phones inwhich the phone's display screen is vibrated by a transducer so that thedisplay screen functions as a loudspeaker. Using the display as aspeaker allows a phone manufacturer to omit an earpiece speaker,enabling use of a smaller bezel and a larger display as compared tophones that include an earpiece speaker. However, generatinghigh-quality sound reproduction that is satisfactory for telephony andfor audio playback, such as a playing a high-definition movie, using thedisplay as a speaker has proven challenging.

IV. SUMMARY

According to one implementation of the present disclosure, a device toprocess an audio signal representing output sound includes one or moreprocessors configured to generate, responsive to sensor data indicativeof pressure detected at a housing of the device, output data based on apredicted effect of the pressure on an acoustic output of the device.The one or more processors are also configured to, responsive to theoutput data, adjust operation of an audio playback component thatgenerates the acoustic output.

According to another aspect of the present disclosure, a method ofprocessing an audio signal representing output sound includesgenerating, responsive to sensor data indicative of pressure detected ata housing of a device, output data based on a predicted effect of thepressure on an acoustic output of the device. The method also includes,responsive to the output data, adjusting operation of an audio playbackcomponent that generates the acoustic output.

According to another aspect of the present disclosure, a non-transitorycomputer-readable medium includes instructions that, when executed byone or more processors of a device, cause the one or more processors togenerate, responsive to sensor data indicative of pressure detected at ahousing of the device, output data based on a predicted effect of thepressure on an acoustic output of the device. The instructions, whenexecuted by the one or more processors, also cause the one or moreprocessors to, responsive to the output data, cause an adjustment ofoperation of an audio playback component that generates the acousticoutput.

According to another aspect of the present disclosure, an apparatus toprocess an audio signal representing output sound includes means forgenerating, responsive to sensor data indicative of pressure detected ata housing of a device, output data based on a predicted effect of thepressure on an acoustic output of the device. The apparatus alsoincludes means for adjusting operation, responsive to the output data,of an audio playback component that generates the acoustic output.

V. BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of a particular illustrative implementation of asystem including a display sound device operable to perform pressurecompensation.

FIG. 2 is a diagram of a particular implementation of the device of FIG.1.

FIG. 3 is a diagram of another particular implementation of the deviceof FIG. 1.

FIG. 4 is a diagram of graph showing changes of frequency responses ofmultiple display sound devices, including the device of FIG. 1, assupport pins are applied to and removed from the backs of the devices.

FIG. 5 is a diagram of another implementation of a device operable todetermine pressure compensation.

FIG. 6 is a diagram of an implementation of a method of performingpressure compensation that may be performed by the device of FIG. 1.

FIG. 7 is a diagram of a vehicle operable to perform pressurecompensation for display sound device.

FIG. 8A is a diagram of a virtual reality or augmented reality headsetoperable to perform pressure compensation.

FIG. 8B is a diagram of a wearable electronic device operable to performpressure compensation.

FIG. 9 is a block diagram of a particular illustrative example of adevice that is operable to perform pressure compensation.

VI. DETAILED DESCRIPTION

Devices and methods are described that compensate for pressure on adisplay sound device. Although display sound phones enable use of asmaller bezel and a larger display as compared to phones that include anearpiece speaker, generating consistently high-quality sound has provenchallenging. In particular, pressure applied to the back (or sides) of adisplay sound phone affects the audio playback quality of the phone. Asa non-limiting example, a low-frequency response of a conventionaldisplay sound phone changes due to vibration dampening based on thepresence and location on the backplate of the phone of a finger, palm,mount support, or any other structure applying pressure to thebackplate.

Compensation for audio playback effects due to externally appliedpressure are achieved by adaptively adjusting audio playback based onpressure detected on a housing of a display sound device. For example,sensors (e.g., force or pressure sensors) can be embedded in a backplateof the display sound device and the resulting sensor data can be used toestimate a user's hand placement. An equalization filter may bedetermined based on the estimate of the user's hand placement andapplied to an audio playback signal to reduce or eliminate an effect ofthe user's hand on the acoustic response of the display sound device. Asanother example, one or more transducer drive signals may be adjusted toreduce or eliminate an effect of the user's hand on the acousticresponse of the display sound device. In some implementations, anadaptive filter is implemented to provide further compensation based ona feedback signal from audio playback. By adaptively adjusting audioplayback based on pressure detected on a housing of a display sounddevice, variation of the acoustic response of the display sound devicedue to the externally applied pressure can be reduce or eliminated,providing a user of the device with a consistent audio playback qualitythat is substantially independent of how the user holds or otherwisesupports the display sound device.

Unless expressly limited by its context, the term “producing” is used toindicate any of its ordinary meanings, such as calculating, generating,and/or providing. Unless expressly limited by its context, the term“providing” is used to indicate any of its ordinary meanings, such ascalculating, generating, and/or producing. Unless expressly limited byits context, the term “coupled” is used to indicate a direct or indirectelectrical or physical connection. If the connection is indirect, theremay be other blocks or components between the structures being“coupled”. For example, a loudspeaker may be acoustically coupled to anearby wall via an intervening medium (e.g., air) that enablespropagation of waves (e.g., sound) from the loudspeaker to the wall (orvice-versa).

The term “configuration” may be used in reference to a method,apparatus, device, system, or any combination thereof, as indicated byits particular context. Where the term “comprising” is used in thepresent description and claims, it does not exclude other elements oroperations. The term “based on” (as in “A is based on B”) is used toindicate any of its ordinary meanings, including the cases (i) “based onat least” (e.g., “A is based on at least B”) and, if appropriate in theparticular context, (ii) “equal to” (e.g., “A is equal to B”). In thecase (i) where A is based on B includes based on at least, this mayinclude the configuration where A is coupled to B. Similarly, the term“in response to” is used to indicate any of its ordinary meanings,including “in response to at least.” The term “at least one” is used toindicate any of its ordinary meanings, including “one or more”. The term“at least two” is used to indicate any of its ordinary meanings,including “two or more.”

The terms “apparatus” and “device” are used generically andinterchangeably unless otherwise indicated by the particular context.Unless indicated otherwise, any disclosure of an operation of anapparatus having a particular feature is also expressly intended todisclose a method having an analogous feature (and vice versa), and anydisclosure of an operation of an apparatus according to a particularconfiguration is also expressly intended to disclose a method accordingto an analogous configuration (and vice versa). The terms “method,”“process,” “procedure,” and “technique” are used generically andinterchangeably unless otherwise indicated by the particular context.The terms “element” and “module” may be used to indicate a portion of agreater configuration. The term “packet” may correspond to a unit ofdata that includes a header portion and a payload portion. Anyincorporation by reference of a portion of a document shall also beunderstood to incorporate definitions of terms or variables that arereferenced within the portion, where such definitions appear elsewherein the document, as well as any figures referenced in the incorporatedportion.

As used herein, the term “communication device” refers to an electronicdevice that may be used for voice and/or data communication over awireless communication network. Examples of communication devicesinclude smart speakers, speaker bars, cellular phones, personal digitalassistants (PDAs), handheld devices, headsets, wearable devices,wireless modems, laptop computers, personal computers, etc.

FIG. 1 depicts a system 100 that includes a display sound device 102that is configured to generate output sound by vibrating a display 140.The display sound device 102 is configured to process an audio signalrepresenting the output sound to compensate for an effect of pressureapplied to a housing 160 of the device 102, such as by a hand 190holding the device 102. In some implementations, the device 102 caninclude a portable communication device (e.g., a “smart phone”), awearable device (e.g., a “smart watch”), a vehicle system (e.g., amovable or removable display for use with an automobile entertainmentsystem, navigation system, or self-driving control system), or a virtualreality or augmented reality headset, as illustrative, non-limitingexamples.

A block diagram 192 illustrates components of the device 102, includingone or more sensors 104, a pressure effect predictor 110, a pressureeffect compensator 120, an audio playback component 130, an adaptivefiltering unit 150, and the display 140. The audio playback component130 is configured to vibrate the display 140 to generate an acousticoutput 106, such as by controlling a transducer, such as a mechanicaltransducer, that is mechanically coupled to the display 140. Becausepressure on the housing 160 can affect a frequency response of thedevice 102, such as by dampening of backplate propagation or leakage ofvibration through the backplate 162, the device 102 is configured todetect and compensate for such pressure to reduce or eliminatedistortion of the acoustic output 106.

A perspective view 194 illustrates an example of pressure points on thebackplate 162 and a sidewall 164 of the housing 160, including a contactregion 170 of an first finger, a contact region 171 of a second finger,a contact region 172 of a third finger, a contract region 173 of afourth finger, a contact region 174 of a palm, and a contact region 175of a thumb. Because different users with different hand sizes, left-handor right-hand preferences, preferred orientations (e.g., landscape modefor video consumption, portrait mode for audio or videotelecommunication), or other preferences can result in different contactregion patterns and differing amounts of pressure applied to the housing160, the contact region pattern 170-175 is depicted for purposes ofillustration only and should not be considered limiting.

The sensor(s) 104 are coupled to the housing 160 and configured todetect one or more locations of contact with the backplate 162, one ormore sides of the housing 160 (e.g., the side 164), or a combinationthereof. For example, the sensor(s) 104 can include one or more pressuresensors, capacitive sensors, deformation sensors, optical sensors,infrared sensors, or any combination thereof, as illustrative,non-limiting examples. The sensor(s) 104 may be embedded in a surface ofthe housing 160 and may be substantially or entirely imperceptible to auser if the device 102. In some implementations, the sensor(s) 104 arearranged in a regular pattern to provide substantially equal detectioncapability at all portions of the backplate 162, one or more sides, or acombination thereof. In other implementations, the sensor(s) 104 arearranged to provide higher accuracy detection capability at specificportions of the backplate 162, at specific portions of one or more sidesof the housing 160, or a combination thereof, that are determined to belikely points of contact based on statistical data indicative of a largepopulation of users holding the device 102. In some implementations,relatively few (or none) of the sensor(s) 104 are configured to detectcontact with the sides of the housing 160, providing reduced cost andcomplexity. To illustrate, in some implementations, effects on theacoustic response of the device 102 due to pressure on the sidewalls ofthe housing 160 are relatively small as compared to the effects on theacoustic response due to pressure on the backplate 162.

The pressure effect predictor 110 is configured to receive informationindicative of pressure detected at the housing 160 of the device 102,such as sensor data 105 from the sensor(s) 104 indicating a physicalhand placement on the device 102. The pressure effect predictor 110 isconfigured to generate output data 112 responsive to the sensor data 105and based on a predicted effect of the pressure on an acoustic output ofthe device 102. For example, in some implementations the pressure effectpredictor 110 includes a classifier (e.g., in an implementation thatincludes neural network or machine learning to train the classifier togenerate the output data 112 responsive to the sensor data 105), alook-up table, a filter (such as a Kalman filter), or any combinationthereof.

In some implementations, the output data 112 includes a parametricoutput indicating how many points of contact are detected and where thedetected points of contact are located. In one example, the output data112 includes coordinates (e.g., a grid location, a centroid and area, aboundary, or other coordinate type) of detected points of contact on asurface of the housing 160. In another example, the output data 112indicates one of a predefined set of contact patterns that represents abest fit to the sensor data 105 as compared to the other predefinedcontact patterns. Alternatively, or in addition, the output data 112indicates a predicted variation or effect of the acoustic response ofthe device 102 based on a contact pattern represented by the sensor data105.

The pressure effect compensator 120 is responsive to the output data 112to adjust operation of the audio playback component 130 that generatesthe acoustic output 106 via vibrating the display 140. To illustrate, acompensator output 122 is generated that causes the audio playbackcomponent 130 to adjust one or more gains, phases, frequency bandattenuation or amplification, or any combination thereof, to at leastpartially offset, or compensate for, the predicted variation or effectof the acoustic response of the device 102. In some implementations, thepressure effect compensator 120 outputs a drive signal to a singlemechanical transducer, as described with reference to FIG. 2, or outputsmultiple drive signals to multiple mechanical transducers, as describedwith reference to FIG. 3.

The adaptive filtering unit 150 is configured to receive a feedbacksignal and to generate an adjustment signal 152 to further to adjustoperation of the audio playback component 130. In some implementations,such as described further with reference to FIGS. 2-3, the adaptivefiltering unit 150 is configured to receive the feedback signal from oneor more feedback microphones. In some implementations, the adaptivefiltering unit 150 is configured to generate the adjustment signal 152based on a measured acoustic response of the device 102 and a targetfrequency response. For example, the target frequency response cancorrespond to an industry specification, such as a 3rd GenerationPartnership Project (3GPP) specification regarding user equipment (UE)Receive Frequency Response (RFR).

In some implementations, the pressure effect predictor 110, the pressureeffect compensator 120, or any combination thereof, are implementedusing dedicated circuitry or hardware. In some implementations, thepressure effect predictor 110, the pressure effect compensator 120, orany combination thereof, are implemented via execution of firmware orsoftware. To illustrate, the device 102 can include a memory configuredto store instructions and one or more processors configured to executethe instructions to implement the pressure effect predictor 110 and thepressure effect compensator 120, such as described further withreference to FIGS. 2-3 and FIG. 9.

By adaptively adjusting audio playback based on pressure detected on thehousing 160 of the device 102, variation of the acoustic response of thedevice 102 due to the externally applied pressure can be reduced oreliminated, providing a user of the device 102 with a consistent audioplayback quality that is substantially independent of how the user holdsor otherwise supports the device 102.

Although FIG. 1 describes detecting and compensating for acousticresponse effects due to contact by the hand 190, it should be understoodthat the device 102 may detect and compensate for pressure or contactfrom any source. For example, the device 102 may be implemented in anelectronic watch, virtual reality headset, or other wearable device thatdetects pressure against a wearer's wrist or face, respectively. Asanother example, the device 102 may be implemented with a phone case ora with “kickstand” to hold the device 102 substantially vertically,placed in a car phone holder, or used in conjunction with one or moreother support mechanisms that place pressure on the backplate 162 orsides of the housing 160. In a specific example, the device 102 can bemounted on a handset positioner, with or without support pins, forpurposes for Receive Frequency Response measurement.

FIG. 2 depicts a first implementation 200 showing further aspects ofcomponents that can be implemented in the device 102 of FIG. 1. Asillustrated in FIG. 2, the audio playback component 130 includes amechanical transducer 206, such as an actuator, that is configured to becoupled to the display 140. The mechanical transducer 206 is responsiveto a drive signal 234 to generate at least a portion of the acousticoutput 106 by vibrating the display 140.

The pressure effect predictor 110 includes a hand placement predictor210 that is configured to match the sensor data 105 to one or more handplacement models or configurations, providing higher accuracy ofpressure effects on acoustic response when the device 102 is held by ahand as compared to an accuracy of pressure effect estimation that isnot specifically correlated to hand placement models or configuration.

The pressure effect compensator 120 includes an equalizer (EQ) adjustor220 and a signal combiner 230. The equalizer adjustor 220 is configuredto generate a compensation signal 222 (e.g., equalization filtersettings or an index of a predetermined equalization filter) based onthe output data 112. The signal combiner 230 (e.g., a multiplier) isconfigured to adjust an audio playback signal 232 based on thecompensation signal 222 and based on the adjustment signal 152 from theadaptive filtering unit 150 to generate an adjusted audio playbacksignal. For example, audio playback signal 232 can correspond to audiodata from an audio or video file, streaming audio or video data ortelephonic audio data received by the device 102, or an audio soundtrackor audio effects corresponding to a gaming application executing at thedevice 102, as illustrative, non-limiting examples. The signal combiner230 outputs the adjusted audio playback signal to the mechanicaltransducer 206 as the drive signal 234.

The adaptive filtering unit 150 receives a feedback signal 226 from oneor more feedback microphones 208. In a particular implementation, theadaptive filtering unit 150 determines parameters of an adaptive filterto minimize an error signal based on determining a frequency response ofthe device 102 (e.g., by comparing frequency components of the feedbacksignal 226 to the audio playback signal 232) and comparing the frequencyresponse to a target acoustic response. The resulting adjustment signal152 causes the signal combiner 230 to adjust the audio playback signal232 to at least partially compensate for a deviation from the targetacoustic response.

The pressure effect predictor 110, the pressure effect compensator 120,and the adaptive filtering unit 150 are implemented in one or moreprocessors 202. To illustrate, the signal combiner 230 can beimplemented as a digital multiplier within the processor(s) 202. Inother implementations, the signal combiner 230 can be implemented as ananalog circuit external to the processor(s) 202.

FIG. 3 depicts a second implementation 300 showing further aspects ofcomponents that can be implemented in the device 102. In contrast toFIG. 2, the audio playback component 130 in FIG. 3 includes multiplemechanical transducers 320-322 configured to be coupled to the display140. Each of the mechanical transducers 320-322 is responsive to arespective drive signal of multiple drive signals to generate at least aportion of the acoustic output 106 by vibrating the display 140. Toillustrate, the audio playback component 130 includes N mechanicaltransducer, where N is an integer greater than 1. A first mechanicaltransducer 320 is responsive to a first drive signal 312, one or moreother mechanical transducers are responsive to one or more other drivesignals, and an Nth mechanical transducer 322 is responsive to an Nthdrive signal 314. The mechanical transducers 320-322 may be spaced apartat various locations along the display 140 to provide greater controlover vibration modes and phase effects as compared to using a singlemechanical transducer to vibrate the display 140.

The pressure effect compensator 120 includes a drive signal controlsystem 310 that is configured to receive the audio playback signal 232and to generate the multiple drive signals 312-314 based on the audioplayback signal 232 and the output data 112. For example, the signalcombiner 230 can receive an adjusted audio playback signal from thesignal combiner 230 based on the audio playback signal 232 and theadjustment signal 152 from the adaptive filtering unit 150.

Although FIGS. 1-3 describe use of the adaptive filtering unit 150 inconjunction with a feedback signal from one or more feedbackmicrophones, in other implementations the adaptive filtering unit 150receives a feedback signal from one or more other sources instead of, orin addition to, from a feedback microphone. In an illustrative example,the adaptive filtering unit 150 is configured to receive the feedbacksignal from an output of a mechanical transducer of the audio playbackcomponent 130, illustrated in FIG. 3 as a feedback signal 227. Thefeedback signal 227 enables the adaptive filtering unit 150 to directlyuse actuator output for adaptive filtering, such as for correcting foreffects of hand placement on the mechanical vibration of the actuator.In other implementations, a feedback signal can be generated byactivating one or more of the transducers 320-322 and using one or moreun-activated transducer 320-322 as a microphone to generate the feedbacksignal.

In some implementations, the adaptive filtering unit 150 can use anerror signal to update the adaptive filter that is based on changes toan acoustic input from a feedback microphone, or transducer change, ordrive signal control system change, or hand placement prediction change.

Although FIGS. 1-3 depict implementations in which the adjustment signal152 is generated by the adaptive filtering unit 150, in otherimplementations the adjustment signal 152 is not generated or used toadjust the audio playback signal 232. For example, in configurations inwhich the additional correction that would be provided by the adaptivefiltering unit 150 is relatively small compared to the correctionprovided by the pressure effect predictor 110 and pressure effectcompensator 120, the adaptive filtering unit 150 may be omitted. Inother implementations, the adaptive filtering unit 150 may beselectively activated or deactivated, such as based on a magnitude ofthe adjustment signal 152. For example, a measure of the adjustmentsignal 152 below a threshold can indicate a condition in which thepressure effect predictor 110 and pressure effect compensator 120provide sufficient compensation for pressure effects and that theadaptive filtering unit 150 can be deactivated.

In some implementations, values of parameters, such as filterparameters, look-up table data, and classifier models used by the device102 (e.g., in the pressure effect predictor 110 and the pressure effectcompensator 120) can be set by a manufacturer or provider of the device102. In some implementations, the device 102 is configured to adjust oneor more such values during the life of the device 102 based ondownloading and installing new model(s). In some implementations, thedevice 102 (e.g., the processor(s) 202) implements machine learning (orartificial intelligence) configured to adjust one or more such valuesduring the life of the device 102 based on detected patterns of appliedpressure and the effectiveness of pressure compensation, such asdetermined by the adaptive filtering unit 150. For example, a history ofsensor data for the device 102 can indicate that a relatively smallnumber of distinct pressure configurations are typically used (e.g.,holding patterns typically used by a user of the device 102), and thehand placement predictor 210 and pressure effect compensator 120 can beupdated to more efficiently detect and compensate for suchconfigurations.

FIG. 4 depicts a graph 400 that compares examples of a frequencyresponse of the device 102 to frequency responses of conventionaldisplay sound devices that do not compensate for pressure effects. Thegraph 400 has a horizontal axis representing frequency and a verticalaxis representing a change of a frequency response, in decibels (dB), ofa device due to pressure applied to and removed from a backplate of thedevice as supporting pins are added/removed from the back of fiveseparate display sound devices (e.g., the device 102 and fourconventional devices). A flat response of 0 dB corresponds to novariation due to changes in support pins.

A first trace 402 (represented by a solid line) remains close to a 0 dBvalue, indicating relatively little to no change in the acousticresponse of the device 102, as compared to the changes in frequencyresponses for four separate devices that do not include adaptivepressure compensation, represented by traces 404, 406, 408, and 410. Asillustrated, the traces 404-410 vary significantly from the 0 dB value,such as approximately between +/−5 dB, demonstrating substantialvariability due to support pin placement, with larger variations atlower frequencies (the left portion of the graph) as compared to athigher frequencies (the right portion of the graph). The reducedvariability demonstrated by the first device 102 as compared to thevariability of the other devices illustrates a technical benefit ofadaptive pressure compensation techniques described with reference toFIGS. 1-4.

FIG. 5 depicts an implementation 500 of a device 502 that includes thepressure effect predictor 110 and the pressure effect compensator 120integrated in a discrete component, such as a semiconductor chip orpackage as described further with reference to FIG. 9. The device 502includes a sensor signal input 510, such as a first bus interface, toenable the sensor data 105 to be received from one or more sensorsexternal to the device 502. The device 502 also includes a compensationdata output 512, such as a second bus interface, to enable sending ofthe compensator output 122 (e.g., as the drive signal 234 or the drivesignals 312-314). The device 502 enables implementation of pressureeffect compensation as a component in a system that includes one or morepressure sensors, a mechanical transducer, and a display, such as in avehicle as depicted in FIG. 7, a virtual reality or augmented realityheadset as depicted in FIG. 8A, a wearable electronic device as depictedin FIG. 8B, or a wireless communication device as depicted in FIG. 9.

Referring to FIG. 6, a particular implementation of a method 600 ofprocessing an audio signal representing output sound is depicted thatmay be performed by the device 102 or the device 502 as an illustrative,non-limiting examples. The method 600 includes generating, responsive tosensor data indicative of pressure detected at a housing of a device,output data based on a predicted effect of the pressure on an acousticoutput of the device, at 602. For example, the output data 112 isgenerated by the pressure effect predictor 110 responsive to the sensordata 105.

The method 600 includes, responsive to the output data, adjustingoperation of an audio playback component that generates the acousticoutput, at 604. For example, the pressure effect compensator 120generates the compensator output 122 that affects operation at the audioplayback component 130. In some implementations, operation of the audioplayback component is adjusted based on equalization filtering, such asdescribed with reference to FIG. 2, or based on adjusting transducerdrive control signals, such as described with reference to FIG. 3.

In some implementations, the method 600 also includes receiving afeedback signal at an adaptive filtering unit, such as the feedbacksignal 226 received at the adaptive filtering unit 150, and generatingan adjustment signal to further adjust operation of the audio playbackcomponent, such as the adjustment signal 152. The feedback signal may bereceived from one or more feedback microphones, such as the feedbackmicrophone(s) 208. In some implementations, the feedback signal isreceived from an output of a mechanical transducer of the audio playbackcomponent, such as the feedback signal 227 illustrated in FIG. 3.

In some implementations, adjusting operation of the audio playbackcomponent includes generating a compensation signal (e.g., thecompensation signal 222) based on the output data, adjusting an audioplayback signal (e.g., the audio playback signal 232) based on thecompensation signal to generate an adjusted audio playback signal, andsending the adjusted audio playback signal to a transducer (e.g., thetransducer 206) to generate at least a portion of the acoustic output byvibrating a display. In some implementations, adjusting operation of theaudio playback component includes generating multiple drive signals(e.g., the drive signals 312-314) based on an audio playback signal(e.g., the audio playback signal 232) and the output data and sending,to each transducer of multiple transducers (e.g., the transducers320-322), a respective drive signal of multiple drive signals togenerate at least a portion of the acoustic output by vibrating adisplay.

The method 600 may be implemented by a field-programmable gate array(FPGA) device, an application-specific integrated circuit (ASIC), aprocessing unit such as a central processing unit (CPU), a DSP, acontroller, another hardware device, firmware device, or any combinationthereof. As an example, the method 600 may be performed by a processorthat executes instructions, such as described with reference to FIG. 9.

FIG. 7 depicts an example of an implementation 700 of the pressureeffect predictor 110 and the pressure effect compensator 120 integratedinto a vehicle dashboard device, such as a car dashboard device 702. Avisual interface device, such as the display 140, is mounted orpositioned (e.g., removably fastened to a vehicle handset mount) withinthe car dashboard device 702 to be visible to a driver of the car. Thepressure effect predictor 110 and the pressure effect compensator 120 asillustrated with dashed borders to indicate that the pressure effectpredictor 110 and the pressure effect compensator 120 are not visible tooccupants of the vehicle. The pressure effect predictor 110 and thepressure effect compensator 120 may be implemented in a device that alsoincludes the display 140 and the sensor(s) 104, such as in the device102 of FIGS. 1-3, or may be separate from and coupled to the display 140and the sensor(s) 104, such as in the device 502 of FIG. 5.

FIG. 8A depicts an example of the pressure effect predictor 110 and thepressure effect compensator 120 integrated into a headset 802, such as avirtual reality or augmented reality headset. The display 140 ispositioned in front of the user's eyes to enable display of augmentedreality or virtual reality images or scenes to the user while theheadset 802 is worn, and the sensor(s) 104 are positioned to detect anamount and distribution of pressure, such as from contact with theuser's face and head when worn, or contact with the user's hand (e.g.,to press one or more external controls of on a housing of the headset802).

FIG. 8B depicts an example of the pressure effect predictor 110 and thepressure effect compensator 120 integrated into a wearable electronicdevice 804, illustrated as a “smart watch,” that includes the display140 and sensor(s) 104. The sensor(s) 104 enable detection, for example,of pressure indicative of the position of the wearable electronic device804 on a user's wrist and a tightness of a band around the user's wrist.

FIG. 9 depicts a block diagram of a particular illustrativeimplementation of a device 900 that includes the pressure effectpredictor 110 and the pressure effect compensator 120, such as in awireless communication device implementation (e.g., a smartphone). Invarious implementations, the device 900 may have more or fewercomponents than illustrated in FIG. 9. In an illustrativeimplementation, the device 900 may correspond to the device 102. In anillustrative implementation, the device 900 may perform one or moreoperations described with reference to FIGS. 1-8B.

In a particular implementation, the device 900 includes a processor 906(e.g., a central processing unit (CPU)). The device 900 may include oneor more additional processors 910 (e.g., one or more DSPs). Theprocessors 910 may include a speech and music coder-decoder (CODEC) 908,the pressure effect predictor 110, and the pressure effect compensator120. The speech and music codec 908 may include a voice coder(“vocoder”) encoder 936, a vocoder decoder 938, or both.

The device 900 may include a memory 986 and a CODEC 934. The memory 986may include instructions 956, that are executable by the one or moreadditional processors 910 (or the processor 906) to implement thefunctionality described with reference to the pressure effect predictor110, the pressure effect compensator 120, or any combination thereof.The device 900 may include a wireless controller 940 coupled, via atransceiver 950, to an antenna 952.

The device 900 may include a display 928 (e.g., the display 140) coupledto a display controller 926 and mechanically coupled to one or moreactuators 929, such as the mechanical transducer 206 of FIG. 2 or themechanical transducers 320-322 of FIG. 3. The actuator(s) 929 and amicrophone 912 may be coupled to the CODEC 934. The CODEC 934 mayinclude a digital-to-analog converter 902 and an analog-to-digitalconverter 904. In a particular implementation, the CODEC 934 may receiveanalog signals from the microphone 912, convert the analog signals todigital signals using the analog-to-digital converter 904, and providethe digital signals to the speech and music codec 908. The speech andmusic codec 908 may process the digital signals.

The sensor(s) 104 are coupled to the sensor input 510 to enable sensordata to be operated on by the pressure effect predictor 110. In aparticular implementation, the speech and music codec 908 may providedigital signals to the CODEC 934 that represent an audio playback signalthat includes compensation based on a predicted effect of pressure on ahousing of the device 900, as detected by the sensor(s) 104. The CODEC934 may convert the digital signals to analog signals using thedigital-to-analog converter 902 and may provide the analog signals tothe actuator(s) 929 to drive audio output via vibration of the display928.

In a particular implementation, the device 900 may be included in asystem-in-package or system-on-chip device 922. In a particularimplementation, the memory 986, the processor 906, the processors 910,the display controller 926, the CODEC 934, and the wireless controller940 are included in a system-in-package or system-on-chip device 922. Ina particular implementation, an input device 930 and a power supply 944are coupled to the system-on-chip device 922. Moreover, in a particularimplementation, as illustrated in FIG. 9, the display 928, theactuator(s) 929, the input device 930, the microphone 912, the antenna952, and the power supply 944 are external to the system-on-chip device922. In a particular implementation, each of the display 928, theactuator(s) 929, the input device 930, the microphone 912, the antenna952, and the power supply 944 may be coupled to a component of thesystem-on-chip device 922, such as an interface or a controller.

The device 900 may include a mobile communication device, a smart phone,a cellular phone, a laptop computer, a computer, a tablet, a personaldigital assistant, a display device, a television, a gaming console, amusic player, a radio, a digital video player, a digital video disc(DVD) or Blu-ray disc player, a tuner, a camera, a navigation device, avirtual reality of augmented reality headset, a wearable electronicdevice, a vehicle console device, or any combination thereof, asillustrative, non-limiting examples.

In conjunction with the described implementations, an apparatus toprocess an audio signal representing output sound includes means forgenerating, responsive to sensor data indicative of pressure detected ata housing of a device, output data based on a predicted effect of thepressure on an acoustic output of the device. For example, the means forgenerating the output data can correspond to the pressure effectpredictor 110, the hand placement predictor 210, the processor 202, thedevice 502, the processor(s) 910, one or more other circuits orcomponents configured to generate, responsive to sensor data indicativeof pressure detected at a housing of a device, output data based on apredicted effect of the pressure on an acoustic output of the device, orany combination thereof.

The apparatus also includes means for adjusting operation, responsive tothe output data, of an audio playback component that generates theacoustic output. For example, the means for adjusting operation,responsive to the output data, of an audio playback component thatgenerates the acoustic output can correspond to the pressure effectcompensator 120, the equalizer adjustor 220, the signal combiner 230,the drive signal control system 310, the processor 202, the device 502,the processor(s) 910, one or more other circuits or componentsconfigured to adjust operation, responsive to the output data, of anaudio playback component that generates the acoustic output, or anycombination thereof.

In some implementations, non-transitory computer-readable medium (e.g.,the memory 986) includes instructions (e.g., the instructions 956) that,when executed by one or more processors of a device (e.g., the processor906, the processor(s) 910, or any combination thereof), cause the one ormore processors to perform operations for processing an audio signalrepresenting output sound. The operations include generating, responsiveto sensor data indicative of pressure detected at a housing of thedevice, output data based on a predicted effect of the pressure on anacoustic output of the device. The operations also include, responsiveto the output data, causing an adjustment of operation of an audioplayback component that generates the acoustic output.

Those of skill would further appreciate that the various illustrativelogical blocks, configurations, modules, circuits, and algorithm stepsdescribed in connection with the implementations disclosed herein may beimplemented as electronic hardware, computer software executed by aprocessor, or combinations of both. Various illustrative components,blocks, configurations, modules, circuits, and steps have been describedabove generally in terms of their functionality. Whether suchfunctionality is implemented as hardware or processor executableinstructions depends upon the particular application and designconstraints imposed on the overall system. Skilled artisans mayimplement the described functionality in varying ways for eachparticular application, such implementation decisions are not to beinterpreted as causing a departure from the scope of the presentdisclosure.

The steps of a method or algorithm described in connection with theimplementations disclosed herein may be embodied directly in hardware,in a software module executed by a processor, or in a combination of thetwo. A software module may reside in random access memory (RAM), flashmemory, read-only memory (ROM), programmable read-only memory (PROM),erasable programmable read-only memory (EPROM), electrically erasableprogrammable read-only memory (EEPROM), registers, hard disk, aremovable disk, a compact disc read-only memory (CD-ROM), or any otherform of non-transient storage medium known in the art. An exemplarystorage medium is coupled to the processor such that the processor mayread information from, and write information to, the storage medium. Inthe alternative, the storage medium may be integral to the processor.The processor and the storage medium may reside in anapplication-specific integrated circuit (ASIC). The ASIC may reside in acomputing device or a user terminal. In the alternative, the processorand the storage medium may reside as discrete components in a computingdevice or user terminal.

The previous description of the disclosed implementations is provided toenable a person skilled in the art to make or use the disclosedimplementations. Various modifications to these implementations will bereadily apparent to those skilled in the art, and the principles definedherein may be applied to other implementations without departing fromthe scope of the disclosure. Thus, the present disclosure is notintended to be limited to the implementations shown herein and is to beaccorded the widest scope possible consistent with the principles andnovel features as defined by the following claims.

What is claimed is:
 1. A device to process an audio signal representingoutput sound, the device comprising: one or more processors configuredto: generate, responsive to sensor data indicative of pressure detectedat a housing of the device, output data based on a predicted effect ofthe pressure on an acoustic output of the device; and responsive to theoutput data, adjust operation of an audio playback component thatgenerates the acoustic output.
 2. The device of claim 1, wherein theaudio playback component comprises a transducer configured to be coupledto a display, the transducer responsive to a drive signal to generate atleast a portion of the acoustic output by vibrating the display.
 3. Thedevice of claim 2, wherein the one or more processors are furtherconfigured to: generate a compensation signal based on the output data;and adjust an audio playback signal based on the compensation signal togenerate an adjusted audio playback signal that is output to thetransducer.
 4. The device of claim 1, wherein the audio playbackcomponent comprises multiple transducers configured to be coupled to adisplay, each of the transducers responsive to a respective drive signalof multiple drive signals to generate at least a portion of the acousticoutput by vibrating the display.
 5. The device of claim 4, wherein theone or more processors include a drive signal control system configuredto receive an audio playback signal and to generate the multiple drivesignals based on the audio playback signal and the output data.
 6. Thedevice of claim 1, further comprising one or more sensors coupled to thehousing and configured to generate the sensor data.
 7. The device ofclaim 1, wherein the one or more processors include an adaptivefiltering unit configured to receive a feedback signal and to generatean adjustment signal to further to adjust operation of the audioplayback component.
 8. The device of claim 7, wherein the adaptivefiltering unit is configured to receive the feedback signal from one ormore feedback microphones.
 9. The device of claim 7, wherein theadaptive filtering unit is configured to generate the adjustment signalbased on a measured acoustic response of the device and a targetfrequency response.
 10. The device of claim 7, wherein the adaptivefiltering unit is configured to receive the feedback signal from anoutput of a transducer of the audio playback component.
 11. The deviceof claim 1, further comprising a memory coupled to the one or moreprocessors and wherein the one or more processors are in an integratedcircuit.
 12. The device of claim 1, wherein the one or more processorsare integrated in a portable communication device.
 13. The device ofclaim 1, wherein the one or more processors are integrated in a wearableelectronic device.
 14. The device of claim 1, wherein the one or moreprocessors are integrated in a vehicle.
 15. The device of claim 1,wherein the one or more processors are integrated in a virtual realityor augmented reality headset.
 16. A method of processing an audio signalrepresenting output sound, the method comprising: generating, responsiveto sensor data indicative of pressure detected at a housing of a device,output data based on a predicted effect of the pressure on an acousticoutput of the device; and responsive to the output data, adjustingoperation of an audio playback component that generates the acousticoutput.
 17. The method of claim 16, wherein adjusting operation of theaudio playback component includes: generating a compensation signalbased on the output data; adjusting an audio playback signal based onthe compensation signal to generate an adjusted audio playback signal;and sending the adjusted audio playback signal to a transducer togenerate at least a portion of the acoustic output by vibrating adisplay.
 18. The method of claim 16, wherein adjusting operation of theaudio playback component includes: generating multiple drive signalsbased on an audio playback signal and the output data; and sending, toeach transducer of multiple transducers, a respective drive signal ofmultiple drive signals to generate at least a portion of the acousticoutput by vibrating a display.
 19. The method of claim 16, furthercomprising receiving a feedback signal at an adaptive filtering unit andgenerating an adjustment signal to further adjust operation of the audioplayback component.
 20. The method of claim 19, wherein the feedbacksignal is received from one or more feedback microphones.
 21. The methodof claim 19, wherein the adjustment signal is generated based on ameasured acoustic response of the device and a target frequencyresponse.
 22. The method of claim 19, wherein the feedback signal isreceived from an output of a transducer of the audio playback component.23. A non-transitory computer-readable medium comprising instructionsthat, when executed by one or more processors of a device, cause the oneor more processors to: generate, responsive to sensor data indicative ofpressure detected at a housing of the device, output data based on apredicted effect of the pressure on an acoustic output of the device;and responsive to the output data, cause an adjustment of operation ofan audio playback component that generates the acoustic output.
 24. Thenon-transitory computer-readable medium of claim 23, wherein theinstructions further cause the one or more processors to: generate acompensation signal based on the output data; adjust an audio playbacksignal based on the compensation signal to generate an adjusted audioplayback signal; and send the adjusted audio playback signal to atransducer to generate at least a portion of the acoustic output byvibrating a display.
 25. The non-transitory computer-readable medium ofclaim 23, wherein the instructions further cause the one or moreprocessors to: generate multiple drive signals based on an audioplayback signal and the output data; and send, to each transducer ofmultiple transducers, a respective drive signal of multiple drivesignals to generate at least a portion of the acoustic output byvibrating a display.
 26. The non-transitory computer-readable medium ofclaim 23, wherein the instructions further cause the one or moreprocessors to receive a feedback signal and generate an adjustmentsignal to further adjust operation of the audio playback component. 27.The non-transitory computer-readable medium of claim 26, wherein thefeedback signal is received from one or more feedback microphones. 28.The non-transitory computer-readable medium of claim 26, wherein theadjustment signal is generated based on a measured acoustic response ofthe device and a target frequency response.
 29. An apparatus to processan audio signal representing output sound, the apparatus comprising:means for generating, responsive to sensor data indicative of pressuredetected at a housing of a device, output data based on a predictedeffect of the pressure on an acoustic output of the device; and meansfor adjusting operation, responsive to the output data, of an audioplayback component that generates the acoustic output.
 30. The apparatusof claim 29, further comprising means for generating at least a portionof the acoustic output by vibrating a display.